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Abstract 



. We obtain necessary and sufficient conditions for the existence of strictly sta- 

I tionary solutions of ARMA equations in Banach spaces with independent and iden- 

r~| ' tically distributed noise under certain assumptions. First, we obtain conditions for 

"j^ ■ ARMA(l,g) equations by excluding zero and the unit circle from the spectrum of 

the operator of the AR part. We then extend this to ARMA(p,g) equations. Finally, 
we discuss various examples. 

> 

cN ■ 1 Introduction 
00 

Q ! An ARMA(j9,g) process is a stochastic process {Yt)tez that fulfils the following recursion 
\Q ' equation (ARMA, AutoRegressive Moving Average equation) 

o ■ 

: Yt- a^Yt-i - ... - apYt^p = boZt + . . . + t e Z. 

Here 0-1, ... , dp and bo, . . . ,bq are usually complex numbers and {Zt)t£Z is a sequence 
^ . of random variables, which are mostly either i.i.d. or uncorrelated. Such a sequence is 

! called white noise. Y and Z are complex-valued stochastic processes as this facilitates 

many technical problems. An excellent introduction into time series in general and ARMA 
processes in particular is the monograph by Brockwell and Davis [3]. 

A natural extension is to consider multivariate ARMA processes and one can take a 
further step by looking at ARMA processes in infinite dimensional vector spaces. For an 
introduction into time series in Banach spaces, see the monograph by Bosq [2j and the 
survey articles by Hormann and Kokoszka jTT] and Mas and Pumo |15) . ARMA processes 
in Banach spaces can be applied for example in climate prediction and financial modelling, 
see e.g. flj and [17\. For work in functional data with heavy tails, see for instance the 
article by Meinguet and Segers [14j which deals with extreme value theory of functional 
time series. 
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In this article we study conditions for the existence of solutions of ARMA equations 
in a separable complex Banach space B of the form 

Yt - A^Yt_^ - ... - = B^Zt + ... + B^Zt.,, t G Z, (1) 

where Ai,...,Ap and BQ,...,Bg are linear continuous operators in B. Any ^B- valued 
stochastic process {Yt)tQZ which satisfies this equation is called a solution of the ARMA(p,g) 
equation or an AKM.A{p,q) process. We investigate strictly stationary solutions of ARMA 
equations, where the white noise (^t)tez is a series of Banach-space-valued i.i.d. random 
variables. This extends the work by Bosq [2] who deals with causal weakly and strictly 
stationary solutions of AR equations with finite second-moment white noise. 

Firstly, we generalise results by Brockwell and Lindner |5j and Brockwell, Lindner and 
VoUenbrocker [6j. They give necessary and sufficient conditions for the existence of strictly 
stationary solutions for multivariate ARMA(l,g) equations in terms of the eigenvalues of 
the matrix of the AR part and log^-moment conditions on the white noise. Our approach 
is to partially generalise this by investigating the spectrum of the operator of the AR(1) 
part. Assuming that the spectrum of the autoregressive operator does not contain zero and 
has empty intersection with the unit circle, we derive necessary and sufficient conditions 
for the existence of a strictly stationary solution in terms of finiteness of log^-moments. 
Secondly, we extend our results to ARMA(p,g) processes by using their representations 
as jB^-valued ARMA(l,g) processes. Thirdly, we give an additional representation of the 
solution as a moving average process of infinite order by employing Laurent series. Finally, 
we look at what can happen in the case when zero is in the spectrum or the intersection 
of the spectrum and the unit circle is nonempty by looking at various examples. 



2 Results 

We now give our main results. We first give necessary and sufficient conditions for the 
existence of strictly stationary ARMA(l,g) processes when the spectrum does not contain 
zero and elements of the unit circle. We extend these results to ARMA(p,g) processes. 
Finally, we give a representation of the solution as a moving average process of infinite 
order using Laurent series. 

The proof of the characterisation of the existence of strictly stationary multivariate 
ARMA(l,g) processes in [6] makes use of the Jordan canonical decomposition. A Jordan 
decomposition for operators in Banach spaces does not exist in full generality. Therefore, 
we restrict ourselves to operators in the AR part whose spectra, denoted by cr(y4i), do not 
contain elements of the unit circle S. Let Ai be an operator with (t{Ai) fl S = 0. We can 
diagonalise Ai via an invertible linear continuous operator S : Bi (B B2 ^ B such that 

where Ai : Bi Bi and A2 : -62 — )■ B2 are bounded linear operators with cr (Ai) = {z G 
C : l^l < 1} n cr{Ai) and cr(A2) = G C : |z| > 1} fl a{Ai). This can be proven by using 
functional calculus for holomorphic functions. For a proof see Theorem 6.17 in Kato |12] 
Chapter III.6.4: S^^ is given by S^^ = (P, id— P), where P = J R{z, Ai) dz, with 



2 



7 being a path following the unit circle and R{z, Ai) being the resolvent operator of Ai. 
Bi and B2 are the images of P and id— P. The space Bi ® B2 '■= Bi ^ B2 is endowed 
with a norm, e.g. the maximum norm, that renders it into a Banach space, and S is an 
isomorphism between Bi © B2 and B. Hence Bi © B2 and B can be identified. 

An operator Ai that fulfils <j{Ai) fl § = is called hyperbolic. The notion of hyper- 
bolicity is used in the theory of operator semigroups in the context of stability, see for 
example [lOj. 

We use the same diagonalisation of the ARMA(l,g) equation as in [6]: the ARMA(l,g) 
equation 

Yt - AiYt-i = BoZt + ... + BgZt-,, teZ (2) 

has a strictly stationary solution {Yt)t<zz if and only if the corresponding equation for 

Xt := S-'Yt 

Xt — S'-^AiSXt-i = S'^BqZi + h S~^BgZt-g, t E Z, 

has a strictly stationary solution. We define Jj as the projection on the i-th component 
of Bi © B2 and ^ = UXt for i = 1, 2. Then there is a strictly stationary solution of the 
original equation if and only if there are strictly stationary solutions for 

- KiXf\ = hS-'BoZt + ■■■ + hS-'BgZt_g, teZ, 2 = 1,2. (3) 

Recall that the spectral radius r{Ai) = lim„^oo \/| l^" 1 1 coincides with sup{|A| : A G 
a{Ai)} which justifies the name spectral radius. It is easy to see that r{Ai) < 1 if and 
only if Ai is uniformly exponentially stable, i.e. there exist constants a>0, 0<6<1 
such that 1 1 1 < ab^ for all j G N. The latter condition corresponds to condition (ci) on 
p. 74 in [2|. Hence the condition cr{A) G {z E C : \z\ < 1} is equivalent to the conditions 
in Lemma 3.1 of [2j. 

We now give an extension of Theorem 1 in j6] : 

Theorem 2.1. Let B be a complex separable Banach space and let {Zt)te-L be an i.i.d. 
sequence of B-valued random variables. Let Ai and Bq, . . . ,Bg be linear continuous op- 
erators in B and assume cr{Ai) fl S = 0. Let S be the operator as given above such that 

S^^AiS = ^ ^ . Then the ARMA(l,q) equation ^ has a strictly stationary solu- 

tion Y = {Yt)te'L if 

q 

Elog+||(^Ar'i?fc)Zo|| <oo. 

This moment condition is also necessary under the additional assumption ^ a{Ai). The 
strictly stationary solution is unique in both cases. It is given by Yt = SXt with 

q-l j CO q 

j=0 k=0 j=q k=0 

and 

00 q 

= - E E ^t''hs-'Bk)Zt^,, 

j = l-q fc=(l-j)VO 
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where the series defining X^^^ and X^f^"* converge almost surely absolutely. 

Proof. The proof follows along the lines of the proofs of Theorem 1 and Corollary 1 in 
[6]. We first consider the case cr{Ai) G {z ^ C : \z\ < 1}, then the case C {-2 G C : 

1 < \z\} and finally the general case. 

Case 1: cr{Ai) G {z E C : \z\ < 1} i) Sufficiency: Assume that the moment condition 
is fulfilled. The sufficiency of the conditions follows along the lines of Section 3.2 in [6j. 
Note that because r{Ai) < 1, there are a > and < 6 < 1 such that ||v4{|| < alP . We 
show that this moment condition is sufficient for the almost sure absolute convergence of 

q-l j oo q 



j=0 k=0 



3=1 



k=0 



By using the Borel-Cantelli-Lemma, we show that only finitely many summands have 
norm greater than b'^ for b < b' < 1: 



j=q k=0 
oo q 

< J2F\ab'^\\(j2Ar'Bk)z,_, 



3=q 

oo 



A:=0 



> b'^ 

b' ■ 



5]p[iog+ (ar'||(^^r'ft)z,_, 



3=q 



k=0 



> 3 log 



b' 



The last series is finite because of our moment assumption. Hence the series defining Yf 
converges almost surely absolutely. Obviously, {Yt)tez is a strictly stationary process and 
one can check that it defines a solution of ([2]). 

ii) Necessity and uniqueness: Assume that there is a strictly stationary solution. By 
iterating the ARMA(l,g) equation ([2]) (see equation (22) in [6]), we have 



n-1 



^* = E(E^i"'^0^*-^ + E^r'(E^r'^'^)^*-^- 

j=0 k=0 j=q k=0 



(4) 



i=o 



k=j+l 



By taking the limit in probability as n — )■ oo, the last two summands converge to 
in probabihty (as they converge to in distribution), since {Yt)t&z and {Zt)t£Z are both 
strictly stationary. Hence we get 

= E ( E ^^'"Bk) Z,., + P - Jim X: ( X: A\-'Bk) . 



j=0 A:=0 



3=1 



k=0 



This shows uniqueness. Now assume ^ a{Ai). The Ito-Nisio-Theorem is also valid in 
Banach spaces (see Theorem 6.1 in [13]), therefore we also get almost sure convergence. 
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Hence only finitely many summands may have norm greater than 1, which gives the last 
inequality of the following (in) equalities by the Borel-Cantelli-Lemma: 



>i 



1| 



J2^[\\[J2Ar'B,)zo 

j=q k=Q 
oo q 

j=q k=0 
oo q 



k=0 



> 1 



< oo. 



This gives Elog'' 



(ELo^r'^'^)^o||<oo. 

Case 2: cr{Ai) C {-z G C : 1 < |2;|} i) Sufficiency: Define 



j=0 k=j+l 
q-1 q 



j=-oo 



k=0 



i=— oo fc=max(Oj'+l) 

As in case 1, it follow from the moment condition that the defining series converges 
almost surely absolutely and by similar calculations it follows that is a strictly 

stationary solution of 

ii) Necessity and uniqueness: For obtaining the same result in the case cr{Ai) G {z E 
C : 1 < \z\}, one proceeds as in subsection 3.1.2. in j6]: Note that a^A^^) C {-2 G C : < 
\z\ < 1} by holomorphic functional calculus. One obtains (see equation (25) in [6j) 

Yu = -EAi( E Vi?fc)^«-.-Ev(EVi?fc)^«+. 



j=0 k=j+l j=l 

9-1 , J 



k=0 



~ ^ ] Ai ^ ^ ] A^ ^Bk^ Z^^n-j + A-^ ^Yii_^ 

j=0 k=0 

Again, the last two summands converge to in probability as n — )■ oo and 



oo q 



i=i 



k=0 



has to converge almost surely. This shows uniqueness and gives the same necessary mo- 
ment condition by the same argument. 

The general case: By the discussion preceding Theorem 12. there exists a strictly 
stationary solution if and only if admits a strictly stationary solution for i = 1,2. By 
the cases 1 and 2, this holds if (and only if in the case ^ a{Ai)) 



Elog+ ||(EArt'5-^5fe)Zo|| < oo for i = 1,2 
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k=0 



which is in turn equivalent to 



k=o ^ 

= E\og+\\iJ2iS-' A,Sy-'^S-'Bk)Zo\\ 

k=0 

= E\og'-\\iJ2S-'Ai-'B,)Zo\\. 



k=0 

Finally, this is true if and only if Elog"*" \ \Cl2'k=o ^i~^^k)Zo\ \ < oo because S is invertible 
and continuous. The uniqueness and the specific form of the solutions are clear from the 
cases 1 and 2 and the discussing preceding Theorem 12.11 □ 

One can hope that one can also use a continuous operator Ai with the property that 
lim„_!.oo A'^x = for all x G i3 as we then still have A^Z -4 for a random variable Z and 
hence for A^Zt_n for a strictly stationary process {Zt)t^z. An operator with this property 
is called strongly stable, see [9j, Definition 2.1. There are strongly stable operators with 
spectral radius one. For example, consider a multiplication operator Ai on defined 
by y4i(xo, . . .) = (AqSq, AiXi, . . .). Recall that (y{Ai) = {Aj,zGN}. If we choose a 
sequence < Aj < 1 tending to 1, then r{Ai) = 1, but Ai is strongly stable. However, if 
r{Ai) = 1, then ||v4"|| does not converge exponentially fast to zero and hence sufficient 
log'''-moment conditions cannot be derived in this way. Still, we have the following: 

Corollary 2.1. Let B be a complex separable Banach space and let {Zt)t£Z be an i.i.d. 
sequence of B-valued random variables. Let Ai and Bq, . . . ,Bq be linear continuous oper- 
ators in B. Further assume that Ai is strongly stable. Then the ARMA(l,q) equation ^ 
has a strictly stationary solution Y = {Yt)t^z if o-nd only if 

n-1 



j=q k=0 

If there is a strictly stationary solution, it is unique and is given by 

q-l j n-1 q 

= E ( E ^i"^^) + p - }Too E ( E ^r'^^') 

j=0 k=0 j=q k=0 



t-j- 



Proof. The necessity and uniqueness follows as in the proof of Theorem 12. ll -case 1 since the 
strong stability implies that ELi+i Af-'^Bk^Zt-in+j) A and A^Yt.n ^ 

as n — 7- oo as observed above, so that (jl]) gives the desired convergence conditions. The 
sufficiency follows from the same arguments as given in the proof of Theorem 12.11 since 
convergence in probability is preserved by application of continuous operators. □ 

An example of a strictly stationary AR(1) process with strongly stable Ai but with 
r{Ai) = 1 is given in Proposition 13.21 
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We can extend our results to ARMA(p,g) processes by using the representation as 
an ARMA(l,g) process with new state space endowed with a suitable norm, e.g. the 
maximum of the norms of the components. We follow here Section 5.1 of Bosq [2j. If we 
have the ARMA(j9,g) equation Yf — AiYt^i — ... — ApYt-p = BqZi + BiZt-i + . . . + BgZf^g, 
we set 



Yt 
Zt 



(Xt, ■ ■ ■ , Yt-p+i] 



(5) 



We further define the operator A on by 





(A, 


A2 ■■ 


• ••• aa 




id 


•• 


. ... 


A = 





id •• 


. ... 








■ id y 



(6) 



We can now regard the old ARMA(p,g) equation as the new ARMA(l,g) equation 

Yt - AY^, = BoZt + b[z^, + ... + %zZr (7) 

Note that {Zt)te'L is also strict white noise. We now consider the operator-valued polyno- 
mial Q defined by 

Q{z) = id -z^-^A^ zv4p_i - Ap. (8) 

Lemma 2.1. We have 

oi^A) := G C|zid— y4 is not invertible} = {z E C\Q{z) is not invertible}. 

Proof. This follows from the proof of Theorem 5.2 p. 130 in Bosq [2]. Bosq states only 
the inclusion C in his proof but his arguments also give equality. □ 

We now apply this representation to Theorem 12.11 

Theorem 2.2. Let Ai, ■ ■ ■ ,Ap and Bq, ■ ■ ■ ,Bg be continuous linear operators in a separa- 
ble complex Banach space B. Let {Zt)te'L be an i.i.d. sequence of B-valued random variables. 
Define Q as in ^ and assume that Q{z) is invertible for all z E C with \z\ = 1. Define 
Bk, Zt and A as in ^ and Then a strictly stationary solution of the ARMA(p,q) 
equation ^ exists if 



Eiog+lK^A^-'^s;)^; 



fc=0 



< oo. 



(9) 



If Q{0) is also invertible, then this moment condition is also necessary. The stationary 
solution is unique. 
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Proof. There is a solution for the ARMA(p,g) equation ([T]) if and only if there is a 
solution for the rewritten ARMA(l,g) equation ([7]). The spectrum (t{A) of A is {z & 
C\Q{z) is not invertible}. Hence by Theorem I2.H a strictly stationary solution exists if 
(and only if in the case Q{0) is invertible) holds. If there is a solution for the rewrit- 
ten ARMA(l,g) equation, it is unique and hence so is the corresponding solution of the 
ARMA(p,g) equation that is given by its first component. □ 

The theory of holomorphic functions extends to holomorphic operator- valued func- 
tions, see e.g. jB], VII §4. Especially, if we have an operator- valued function / that is 
holomorphic on an annulus around the unit circle, then it has a representation as a Lau- 



rent series z^4>n- The operators 0„ are given by 



- f 



f{z) dz, where 7 



is a path following the unit circle, see [.8J, VII Lemma 6.11. Actually, VII Lemma 6.11 in [8J 
is formulated only for a punctured disc, but the proof of the Laurent Series development 
1.11 in [7] only makes use of Cauchy's Theorem and Cauchy's Integral Formula. These 
are also true for operator- valued holomorphic functions, see [8j, §4.1 and §4.2. 
We now give another representation of the unique strictly stationary solution: 

Theorem 2.3. Let {Zt)te_i be strict white noise in a separable complex Banach space B 



satisfying K log \\Zq\ \ < 00. Let Ai, 



Ap and Bq , 



Bq be continuous linear operators 



and let Q be defined by Assume Q{z) is invertible for all z E C with \z\ = 1. Then the 
unique strictly stationary solution Y = {Yt)t£z of the ARMA(p,q) equation ^^ is given by 



k=—oo 

where the series converges almost surely absolutely and where {ipk)kez denote the coef- 
ficients of the Laurent series of {id—zAi — z^ A2 — ■ ■ ■ z^ A^^^{Bq + zB\ + . . . + -z'^-Bg) 
for an annulus containing the unit circle S. The coefficients {ipk)k& cii"^ given by ipn = 



- f 



'\id -zAi - z'^A2 zPAp)-^{Bq + zBi + . . . + zW^) dz. 



Proof. We first show that Q{z) ^ is a holomorphic function. For that, observe that from 
the proof of Theorem 5.2 in [2j it holds 



M{z){z\d-A)N{z) 



/id 
id 

Vo ... 



\ 

id 

Q{z)J 



-: R{z). 



Here N{z) is a suitable upper triangular matrix with diagonal entries id and upper entries 
of the form z'^ id. The matrix M is given by 



/O -id ... \ 
-id ... 



M{z) 



\id Qi{z) 



-id 
... Qp-i{z)J 



8 



where Qi{z), . . . , Qp^i{z) are operator- valued polynomials. The inverse of M is given by 

[Qi{z) Qp-i{z) id\ 

-id ... 

Miz)-'= ••. 

... -id 
\ -id J 

Thus M{z)~^ is a holomorphic function. The inverse of N{z) can be easily given by 
Cramer's rule and is hence holomorphic as well. The inverse of {z id —A) is the resol- 
vent of A and it is known that the resolvent is a holomorphic function. Hence R{z)~^ is 
holomorphic and hence so is Q{z)^^. 

Now observe that {id—zAi — z'^A2 — ■ ■ ■ z^Ap)~^ = {z^Q{z~^))^^. Hence this function 
is holomorphic on an annulus containing the unit circle. This shows that we can develop 
(id —zAi — 7? Ai — ■ ■ ■ z^ Ap)~^{Bq + zBx + . . . -|- z'^Bq) as a Laurent series by the discussion 
preceding this theorem. 

Finally, we show that the series defining Yt converges almost surely absolutely: the 
Laurent series X]fc^-oo ^'^'^fc converges absolutely on an annulus containing the unit circle. 
As in the proof of Theorem 3.1.1 in [3j we find the same exponential decay of | | as in the 
one-dimensional case: the Laurent series is absolutely convergent, hence ^^^(l + £)""4^n 
and ~^)~^'^-n are also absolutely convergent for e > small enough. Hence there 

are a > and < 6 < 1 such that \\^n\\ < The proof of the almost sure absolute 
convergence is the same as in the proof of Theorem 12. II and one can check that {Yt)tez is 
a strictly stationary solution. 

□ 

Remark 2.1. The assumption that BQ,...,Bq are continuous operators is in fact not 
needed. In Theorem 12.11 the white noise could be an i?-valued sequence, where E is 
a measure space with Bk : E B being measurable mappings. In Theorem 12. 3[ the 
mappings can be continuous operators from a normed space ^ to i3 or also only measurable 
mappings, if we assume Epog"*" \ \BoZt + BiZt^i + . . . + BqZt-q\\] < oo. 

If {Zt)tei is weak white noise, i.e. a sequence of second order random variables with 
constant expectation and constant covariance operator and whose cross covariance oper- 
ators vanish, then Yt = YlT=-c<y'^kZt-k is well-defined and defines a weakly stationary 
sequence and hence a weakly stationary solution of the ARMA equation. See Definition 
2.4 and Definition 3.1 in [2] for the definitions of weak white noise and weak stationarity. 
Hence we get a corollary which generalises Theorem 3.1 in [2j: 

Corollary 2.2. Let Ai, - ■ ■ ,Ap and Bq, ■ ■ ■ ,Bq be continuous linear operators in a sepa- 
rable complex Banach space B. Define Q as in ^ and assume that Q{z) is invertible for 
all z E C with \z\ = 1. Let {Zt)t& be weak white noise with E[Zo] = 0. The ARMA(p,q) 
equation ^ then has a unique weakly stationary solution Y = {Yt)tei given by 



^k'^t-ki 



Yt=Y,^k 

k=—oo 

where the series converges almost surely absolutely and in the L'^-sense. 
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Proof. The existence as an almost surely absolutely convergent series can be established 
similar to Proposition 3.1.1. in [3j. The sequence (^^^_,^ '?/'fc-^t-fc)nGN is a Cauchy sequence 
in the space of square integrable random variables as 

k=—n k=—m k=—n k=—m 

which follows from the proof of Theorem 6.1 in [2j. The uniqueness follows along the 
lines of the proof of Lemma 3.1 in However, the last argument of the proof uses 
Slutsky's Lemma. This cannot be applied, but the convergence in probability follows 
from Tchebychev's inequality. Finally, it it obvious that {Yt)t&i is weakly stationary and 
one can check that it is a solution. □ 



3 Examples 

3.1 Weaker moment conditions if (t{Ai) = {0} 

We already know that a log^-moment is sufficient for the existence of a solution of the 
AR(1) equation Yt — AiYt-i = Zt if cr(Ai) = {0}. We now give examples to show that 
this sufficient condition is not necessary in this case. 

Example 3.1. The first example is that Ai is the zero operator or more generally nilpo- 
tent, i.e. there is a power that vanishes. The spectral radius is then r{Ai) = 0, hence 
cr{Ai) = {0}. The series Yl'^=o ^iZt-n always converges. Hence there is no necessary 
moment condition. 

In the next example, the spectral radius of the operator Ai vanishes, i.e. r{Ai) = and 
cr{Ai) = {0} but Ai is not nilpotent. Recall that such operators are called quasinilpotent. 

Example 3.2. Consider the weighted right shift Ai on Cq{N) given by Ai{xo, Xi,X2, ■ ■ ■) = 
(0, ctiXo, 02X1, . . .) for a monotone sequence ctj > tending to zero. We then have = 
flifl2 ■ ■ "fln- We set a„ = for n > 1 and ai = e~^, hence ||v4"|| = e~^". We claim 

that the condition Epog^log"*" ||^o||] < 00 is sufficient for the existence of a solution of 
the corresponding AR(1) equation and that this moment condition is sharp inasmuch 
as there cannot be a better sufficient moment condition. What is more, the condition is 
indeed different from the usual log^'^-moment condition in that there are distributions with 
log"^ log'''-moments without log'''-moments. 

Proof. Sufficiency: We know from the proof of Theorem 12.1 1 that there is a strictly station- 
ary solution for Yt—AiYt^i = Zt if X]^o ^iZt-n converges almost surely absolutely. Hence 
it suffices to show that ||y4"Zj_„|| > e~" only finitely often. We show this by the Borel- 
Cantelli-Lemma. First note that there is a i^' such that log(e" — n) = n + log(l — ne~"') > 
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n — 2 for n > K. Hence 

oo 

J2nU-iZt-n\\>e-^] 

n=K 

oo 

< ^ P[fog+fog+ llZoll > fog(e" - n)] 

n=K 

oo ^ 

< ^P[fog+fog+po|| >n--]. 

n=K 

The last series is finite if E[log'''log^ ll-2^o||] < oo. Tlie Borel-Cantelli-Lemma tlien sliows 
tliat a strictly stationary solution exists. 

Sharpness: We denote the n-th component of Yt and Zt by f/"'' and . One can 
show that a solution has to fulfil Y^"'^ = 'Yyi=oiYYj=i+i^j)Zt+i-n- ^^^^ know that 
lim„^oo = almost surely because the solution is in Co(N). If we assume that only zj:^'^ 
is nondeterministic and all other component vanish, then the log"^ log'''-moment condition 
is in fact necessary: then the components of f/"^ are independent (for fixed t) and we get 
by the Borel-Cantelli-Lemma, because only finitely many summands have norm greater 
than 1, the following inequality. The finiteness of the first series then gives the log"*" log"*"- 
moment: 

CO 

^P[log+log+|4°^| >n] 

n=l 

oo n 

= J]P[log+|Zr|>-J]loga,] 

n=l i=l 

=e" 

oo " 1 

n=l 1=1 * 

oo n 

= J2^[\C[l^^)zi%\>l]<oc. 

n=l 1=1 

Finally, let P be a real- valued random variable with Pareto distribution on [l,oo) with 
index a = 1. Define Z = xe^ where a; is a vector in B with norm 1. Z has log^ log"*"- 
moment but no finite log^-moment, i.e. there is white noise (^t)tgz fulfilling these moment 
conditions. 

□ 

The spectrum of the operator in the next example contains zero but the log"*" condition 
is necessary. 

Example 3.3. Let Ai be the rescaled right shift operator on £^(N) given by Ai{xq, xi, . . .) = 
^(0, Xo, Xi, . . .). Then Ai is not invertible, thus we have G a{Ai), but Ai has a left inverse 
given by A]^^{xo,Xi, ■ ■ ■) = 2{xi,X2, ■ ■ ■)■ It is known that cr{Ai) = {z E C : \z\ < |}. The 
arguments of the proof of Theorem 12.11 show that the log''"-condition is necessary. 
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We now give another example with a different sufficient condition. Let T be the gamma 
function given by r(^;) = t^'^e'^ dt for z > 0. We know that T{n) = {n — 1)!. Let 
K > be a constant such that F is strictly increasing on [K, oo). We then denote by F^^ 
the inverse function of F on the interval [K, oo). 

Example 3.4. Let B = C[0, 1] be endowed with the supremum norm. Let Ai be the 
Volterra integral operator given by Aix(s) = Jq x{t) dt. Then E[F^"'^(| |Zo| | V K)] < oo is 
a sufficient condition for the existence of a solution for the AR(1) equation given by Ai. 
This condition is sharp as well. 

Proof. We will show that Yt := Yl'^=o^i ^t-n converges almost surely absolutely and we 
know that this then defines a solution for the AR(1) equation. We know that ||v4"|| = ^, 
see for example [S] p. 217 . It suffices to show that ||^Zt_„|| > for only finitely 

many n. We do so by using the Borel-Cantelli-Lemma: 



oo 

E^[ii>oi 



1 

> 



n=2 

oo 



n{n — 1) 
= J]P[||Zo|| > (n-2)!] 

n=2 
oo 

< ^P[||Zo|| V/sT > (n-2)! 



n=2 

oo 



< 5^P[F-i(||Zo||Vi^)>(n-l)]. 



n=2 



The last series is finite because of the moment asumption. Finally, we show that this 
condition cannot be improved: let {Zt)t&z be C-valued i.i.d. white noise and define Zt = 
l[o,i]^t. Now we assume that there is a solution Yt. We evaluate this solution as a function 
at 1, i.e. Yt = Yt{l) = Yl'^=o "^^^^ series necessarily converges if there is a solution 

Yt. Hence again by the Borel-Cantelli-Lemma, we get Xl^^o ^ ^ ^hus 

Er=oP[l^l V is: > n!] < oo and 'E7=o'^[^'WZo\ ^ K) > n + 1] < oo. This shows that 
under this choice of white noise, the moment condition is necessary. 

Finally, we give an example of a distribution with F^^-moment but without log"*"- 
moment: It can be shown that F~^(x) behaves asymptotically like j^^^^'- by Stirling's 
formula, T{y) behaves asymptotically like x := y^(|)^. Taking the logarithm, we obtain 

^ogy/y + y{\ogy - 1) = logx =: z. 

By using the ansatz y = \^^{z) and inserting it in the last equation, one can show that 
lim^_j.oo t(-2) = 1, giving the desired asymptotic behaviour of F~^(x) as a; — )■ oo. 
Now, define fix) := — ^ — i Then, for large Xi 

f{x)\ogxdx= [ — J— j dx= I e^d?/= / — dy 



x>x^ A>xi X log X log log X Jy>i^g evy log y Jy>y^^ x^V^ogy 
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and 

f log X [ \ 

Jx>x, log log X y^/Mogxi y(log2/)2 

Antiderivatives of the integrands are log logy and Hence by restricting / on an 

interval [a;i,oo) and normalising it, we obtain a density that defines a distribution with 
the desired properties of having finite r~^-moment without having log "^-moment . 

□ 



3.2 Examples when cr(^i) is the closed unit disc 

We consider two further examples. In the first one the operator is an isometry and there 
is no nondeterministic solution, while in the second one the operator is a multiplication 
operator and there is a nondeterministic solution. 

For the proof of the next proposition, we need some preparation: a family of random 
variables (Xj)jg/ is said to bounded in probability, if for each e > there exists a 5 > 
such that 

m\Xi\ \ > 5]<e for all i G /. 

Recall that if the partial sums Sn of independent random variables in a separable space are 
bounded in probability, then they are also almost surely bounded, see [18j, Theorem V.2.2. 
b) p. 266. Note that [18j define boundedness in probability by boundedness with respect to 
a metric space that induces convergence in probability. Then they show that it coincides 
with this definition (Proposition III. 1.2. p. 93). Recall that almost sure boundedness means 
that the supremum is almost surely finite, i.e. P[sup„ \ \Sn\ \ < oo] = 1. Finally, recall that 
a Banach space B does not contain subspaces being isomorphic to Co(N) if and only if 
for every sequence of independent symmetric Radon random variables in B, the almost 
sure boundedness of the sequence of the partial sums Sn implies its convergence, see [T3] . 
Theorem 9.29. 

Proposition 3.1. Let Ai be an isometry and B be a separable Banach space, that does 
not contain a subspace being isomorphic to Co(N), e.g. a Hilbert space. Then a necessary 
condition for the existence of a strictly stationary solution for the AR(1) equation Yt — 
AiYt_i = Zt with {Zt)tez i-i-d. is that Zq is almost surely deterministic. 

Proof. We will mimic the argument of the proof of Theorem 1 in [_5j c) . We may symmetrise 
the processes by taking the differences of two independent copies of the white noise and 
the solution. We then show that Zq vanishes almost surely. We now assume that the white 
noise and the solution are symmetric. We again obtain 

n-l 
k=0 

From the stationarity and the fact that A" are isometrics, for each e > there is a > 
such that 

F[\\Yt ~ A'lYt.nW > K] < e 
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as we have 



nm - A'lY,_r^\\ > K]<F[m\\ > y}u{ii^"y,ii > ^}] < 2P[||y,ii > 

Hence 

n-l 



J2AiZt-k\\>K]<e 



k=0 

and the Yl^Zo ^i^t-k ^re bounded in probabihty, hence almost surely bounded and thus 
Yl'h=o^i^i-k converges almost surely (by the theorems refered to above). We now have 

oo oo 

J]P[||Zo|| > r] = ^P[||A^Zt_fe|| > r] < oo for all r > 0. 

k=0 k=0 

Thus Zq vanishes almost surely. □ 

Example 3.5. Let B be ^°°(N) and let Ai be the unilateral right shift defined by 
A,{xo,xu...) = {0,xuX2,...). We set = and = {y}'\y,^'\ . . .). 

Then Y^^^ := X]r=o ^t+i-n ^ stationary solution as long as Yt is in £°°(N). If we assume 

sup^g^ supjg^ \ Z^^^\ < 2^*, then the Y^ are always bounded by 2, hence a strictly station- 
ary solution exists though the shift is an isometry. This example docs not contradict our 
proposition above as wc have Co(N) C £°^(N) and £°°(N) is not separable. 

We again consider the AR(1) equation in the case that Ai is a multiplication operator 
given by Ai{xo,Xi, . . .) = {X^xq, XiXi, . . .) on We set Zt = {zf\z[^\...) and 

Yt = (y/"'' , y/^'' , . . .). Define af = Yai{zj:^''). If we consider a component of a solution of 
the AR(1) equation Yt - A^Yt^i = Zt, we have f/"^ = T^ZoK^i-i hence Var(F/"^) = 
E^=o('^i)^ Var(Zj^!5) = j^. If Er=oVar(F/"^) is finite, then Yt is almost surely in 
and we choose a modification of Y that is in Hence we get: 

Proposition 3.2. Let Ai be a multiplication operator in £^(N) defined by a sequence 
(Ai)ieN with < 1 for all i. Let {Zt)tez be i.i.d. and with the notation introduced above 
assume X^i^o'^i^ ^ Then there is a solution for the AR(1) equation given by Ai if 

oo 2 

If the white noise is Gaussian, then this condition is also necessary. In particular, E[||Zt|p] < 
oo is not a sufficient condition for the existence of a strictly stationary solution. 

Proof. The sufficiency has already been observed above. To show necessity when {Zt)tez 
is Gaussian, consider only the first n + 1 components of the AR(1) equation. For this 
multivariate equation, there is always a solution and the distribution of the solution 
(y/°\ . . . , y/""*) is Gaussian. If Yt is well-defined in its state space £^(N), then its distribu- 
tion is Gaussian, because every linear functional of Yt is an almost sure limit of the linear 
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functionals of {Y^ ,. . . ,1^/ ). These are normally distributed and the normal distribu- 
tions are closed under convergence in distribution. The diagonal entries of the covariance 

2 

operator of the distribution of Yt are given by j^^- Recall that the diagonal entries of 

a covariance operator of a Gaussian measure on £^(N) have to be summable, see [18j, 
Theorem V.5.6 p. 334. □ 

We know that the spectrum of the unilateral right shift R in £^(N) has the closed unit 
disc as spectrum. We also know that the spectrum of the multiplication operator M is 
{Xi : i G N}. We can now choose a sequence (Aj)ieN with |Aj| < 1, such that (t{R) = a{M). 
The shift is an isometry, hence we already know that the corresponding AR(1) equation 
has no strictly stationary solution but we also know that in the case of the multiplication 
operator M we have a solution, if we choose a priori appropiate white noise. 

The operator in the next example has the disc with radius 2 as spectrum. 

Example 3.6. Let Ai be the rescaled right shift operator on £^(N) given by Ai{xq, Xi, . . .) = 
2(0,Xo,Xi, . . .). Then Ai has a left inverse given by A'^'^(xo,Xi, ■ ■ ■) = ^{xi,X2, ■ ■ ■)■ There 
is no solution for the corresponding AR(1) equation if Zq is nondeterministic. 

Proof. We mimic the arguments given in [3j p. 81 for the noncausal univariate AR(1) 
equation. If there is a solution for the AR equation, we multiply the equation with A^'^ 
and get A'^'^Xt — Xt_i = A^^Zt and rearrange it to Xt = —A^^Zt+i + A^^Xt^i. Iteration 
gives Xt = —A^^Zt^i — ■ ■ ■ — A^'^Zt+n + ^r"^t+n- By taking the limit in distribution 
and applying again the Ito-Nisio-Theorem one sees that if there is a solution for the 
corresponding AR(1) equation for Ai, then it is unique and fulfils Xt = — X^^i ^i'' ^t+j 
as an almost sure limit. Hence on the one hand, we have ^ = - 2~^'^liV 
other hand we also have X^^^ = zf^ but this is impossible unless Zq is deterministic. □ 



4 Summary 

The aim of this article was to find necessary and sufficient conditions for the existence of 
strictly stationary solutions of ARMA equations in Banach spaces with i.i.d. white noise. 

Firstly, we generalised a result on multivariate ARMA(l,g) processes by Brockwell, 
Lindner and Vollenbroker [6] by excluding the unit circle and zero from the spectrum of 
the operator in the autogressive part. Secondly, we extended this to ARMA(p,g) processes 
by using their representations as ARMA(l,g) processes. Thirdly, we gave an additional 
representation of the solution by using Laurent series. Finally, we provided various exam- 
ples illustrating what can happen when we drop our assumptions. These examples show 
that a complete characterisation of the existence and uniqueness of strictly stationary 
solutions by the spectrum and moment conditions is not possible. 

Our work extends the results in the book by Bosq [2] in that we allow for noncausal 
solutions, a broader class of operators, white noise without finite second moments and a 
moving average part. 
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